OrthoBoSampler Implementation#375
Open
Galvanized-Heart wants to merge 6 commits into
Open
Conversation
Member
|
@kAIto47802 Could you review this PR? |
kAIto47802
reviewed
May 27, 2026
Co-authored-by: Kaito Baba <115693559+kAIto47802@users.noreply.github.com>
Author
|
Were there any other things you noticed were necessary updates for the PR? |
Collaborator
|
Thank you for the update. The current total image size is about 211KB, and you can minimize it by the following commands: $stat -c '%n %s' package/samplers/orthobo/images/*.png | numfmt --field=2 --to=si --suffix=B
package/samplers/orthobo/images/Hartmann6.png 98kB
package/samplers/orthobo/images/Levy16.png 113kB$pngquant --quality=70-90 --strip --force --ext .png package/samplers/orthobo/images/Hartmann6.png
$pngquant --quality=70-90 --strip --force --ext .png package/samplers/orthobo/images/Levy16.png$stat -c '%n %s' package/samplers/orthobo/images/*.png | numfmt --field=2 --to=si --suffix=B
package/samplers/orthobo/images/Hartmann6.png 27kB
package/samplers/orthobo/images/Levy16.png 31kBExcept for this point, it almost LGTM, and I think we can merge this PR once you address this point. We sincerely appreciate your contribution! |
Author
|
I got the image sizes down to And formatted them to be 600px wide in the Hope that works for everything! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Contributor Agreements
Please read the contributor agreements and if you agree, please click the checkbox below.
Tip
Please follow the Quick TODO list to smoothly merge your PR.
Motivation
The Optuna ecosystem lacks a sampler that utilizes orthogonalized Bayesian optimization (OrthoBO), addressing issue #374. This technique applies an orthogonal score function control variate for variance reduction over the hyperposterior, leading to improved convergence and stability in hyperparameter optimization compared to naive marginalization.
Description of the changes
OrthoBoSamplerunderpackage/samplers/orthobo/with optional orthonalization.botorchandgpytorchto extract hyperparameters and calculate the diagonal Laplace approximation for the hyperposterior._OrthogonalLogEI) acquisition function.example.py) demonstrating usage on the Hartmann6 benchmark.TODO List towards PR Merge
Please remove this section if this PR is not an addition of a new package.
Otherwise, please check the following TODO list:
./template/to create your package<COPYRIGHT HOLDER>inLICENSEof your package with your nameREADME.mdin your package__init__.pyfrom __future__ import annotationsat the head of any Python files that include typing to support older Python versionsREADME.mdREADME.md